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1. Why these 'Comments'? 

The larger part of the HARP Collaboration (hereafter referred to as 'HARP' or 'authors') 
recently published a paper entitled 'Momentum scale in the HARP TPC [U]. Therein, 
they claim that they calibrated the momentum scale of the HARP TPC with a precision of 
3.5%. They published a paper entitled 'The time response of glass resistive plate chambers 
to heavily ionizing particles' [0]. Therein, they claim a 500 ps time advance of protons 
with respect to minimum-ionizing pions in the HARP multi-gap timing RPCs [OD-[0]- 
Further, they published differential cross-sections of pion production on Ta [ED, C, Cu and 
Sn \M, and Be, Al and Pb M targets. 

We, also members of the HARP Collaboration and referred to as 'HARP-CDP' ^ , have 
not signed the above-cited papers because we are unable to take responsibility for the 
reported calibrations and physics results. 

We shall argue that there is no reason to invoke a new detector physics effect in multi- 
gap timing resistive plate chambers (RPCs), yet there are good reasons why HARP's time 
projection chamber (TPC) and RPC calibrations should not be trusted, and also cross- 
sections of large-angle pion production on nuclear targets based on them. 



CDP stands for CERN-Dubna-Protvino 



2. harp's biased pj scale and bad p^ resolution 

The performance of the HARP TPC was affected by dynamic track distortions that were 
primarily caused by the build-up of an Ar+ ion cloud during the 400 ms long spill of the 
CERN Proton Synchrotron. This ion cloud emanates from the TPC's sense wires and drifts 
across its active volume toward the high- voltage membrane^. 

These dynamic track distortions increase approximately linearly with time in the spill. 
Their size in the r-^ coordinate typically reaches 15 mm, at small radius, at the end of the 
spill. That exceeds the TPC's design r-^ resolution of 500 jim by a factor of 30 and 
therefore requires very precise track distortion corrections. 

The authors published two quite different analysis concepts to deal with dynamic track 
distortions. 

The first concept is to use only the first 100 events out of typically 300 events in the 
whole accelerator spill. From the 'physics benchmark' of proton-proton elastic scattering 
they claim that dynamic distortions do not affect the quality of the first 100 events, and 
hence dynamic track distortions need not be corrected at all. The second concept is a 
correction of the distortions based on a specific radial dependence of the charge density of 
the Ar+ ion cloud. 

In the HARP TPC, with a positive magnetic field polarity, dynamic distortions shift 
cluster positions such that positive tracks are biased toward higher pj (conversely, negative 
tracks are biased toward smaller pj). The authors chose — in principle correctly — to fit 
TPC tracks with the constraint of the beam point because the increased lever arm permits 
an approximate doubling of the pj precision. While the beam point remains unaffected, 
the cluster positions get shifted by dynamic distortions. Assigning a sufficiently small 
position error to the beam point renders its weight (the inverse error squared) in the track 
fit so large that positive tracks get biased toward lower pj, i.e., the trend of the bias is even 
reversed with respect to the fit without beam point. This — artificially enforced — decrease 
of the pj of positive tracks with the time in the spill is demonstrated in the right panel of 
figure 15 in Ref. M- 

This makes clear that the weight assigned in the track fit to the beam point is of 
paramount importance. Despite this importance, the weight of the beam point has never 
been quantitatively stated by HARP. 

Because the bias has different size and opposite sign depending on whether the beam 
point has been used in the fit or not, we recall that in the cross-section results reported by 
HARP the fit with the beam point has been used, but not in all their 'physics benchmarks'. 

There is no claim that HARP's pj scale is wrong per se. Rather, we claim that HARP's 
initially (more or less) correct pj scale develops a bias that increases about linearly with 
the time in the spill. This bias is a direct consequence of the development of dynamic track 
distortions with time in the spill. This means that the percentage of the claimed bias is not 

^The cause of this hardware problem, the physics of the track distortions, their quantitative assessment, 
and their corrections, are described in Refs. [II3]-[II2ll. 



constant but proportional to pj. This means that the claimed bias is a priori different from 
data set to data set since dynamic distortions are different in different data sets. Therefore, 
conclusions on a bias in one data set (e.g., elastic scattering of 3 GeV/c protons on protons 
at rest) cannot be applied quantitatively to other data sets. 

In their first analysis concept (that underlies the cross-sections published in Refs. [[7|]- 
[0]), the authors fit the distorted track together with the undistorted beam point. The beam 
point is assigned a weight 'similar to a TPC hit' [0] which implies that the beam point's 
error is constant and not what it must be: the convolution of the errors of two extrapolations 
to the interaction vertex, of the beam particle's trajectory and of the secondary track's 
trajectory. Primarily because of the momentum-dependence of multiple scattering, the 
correct error of the beam point varies considerably for different beam momenta and from 
track to track. The authors fit a circle to distorted TPC cluster positions that deviate in a 
radius-dependent way by up to 5 mm from their nominal positions, and to the undistorted 
beam point that has a wrong weight in the fit. Under such circumstances, the fit of pj 
cannot be unbiased. 

How large is the bias in this concept? The authors give the answer themselves in 
the upper left panel of figure 17 in Ref. \^ where they show the measurement of the 
specific ionization dE/dx of protons as a function of momentum. One reads off that an 
800 MeV/c proton is measured with a momentum of 650 MeV/c. From this ~20% scale 
error for positive particles at p = 800 MeV/c, one infers a scale error of ~20% in the 
opposite direction for negative particles. Expressed as a shift of q/pj (where q denotes 
the particle's charge), the bias is of order /^{q/p^) ~ +0.3 (GeV/c)^^ for positive magnet 
polarity. 

The effect of this bias is well visible in a comparison of HARP's q/ pi spectrum with 
the one from our group, see figure 10 in Ref. flT^ll . 

In their second analysis concept, the authors apply a correction of dynamic track dis- 
tortions and use data from the whole spill. The correction stems from the electric field 
of a charge density of Ar+ ions that falls with the radial distance R from the beam like 

\/R^ OH. 

Is a l/R^ distribution realistic? The answer is no. The radial charge distribution 
depends on beam energy, beam polarity, beam intensity, beam scraping, target type, photon 
conversion in materials and spiralling low-momentum electrons. Therefore, the correction 
algorithm cannot be expected to work with adequate precision. 

This expectation is confirmed by the difference between the data shown in figure 14 in 
Ref. OJ] and the same data analysed by our group, see figure |T] that shows the q/ pj spectra 
of secondary particles from the interactions of +8.9 GeV/c protons in a 5% Aabs Be target. 

The difference of the spectra is again consistent with a HARP bias of A(^/pt) ~ 
+0.3 (GeV/c)^^ with respect to our results from the same data. 

The authors claim [Q, EL 0] a resolution of 



o{pt)/pi = (0.25 ±0.01)/?T + (0.04 + 0.005) (GeV/c) 
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Figure 1. q/pr spectra of secondary particles from the interactions of +8.9 GeV/c protons in a 5% 
Aabs Be target; the black points are taken from figure 14 in Ref. OH], the histogram represents the 
HARP-CDP analysis of the same data. 



or, approximately, o{1/pt) ~ 0.30 (GeV/c) ^ This claimed resolution refers to fits with 
the beam point included (in fits without the beam point the resolution is around 0.60). 

The information given by the authors on the experimental pj resolution for fits with 
the beam point included (on which all reported cross-sections are based) is very scarce. 
It consists of a mere three points in figure 9 in Ref. [0]. One reads off the resolution 
<7(1//?t) ~ 0.5 (GeV/c)^^ Although this resolution represents a convolution with the 
dE/dx resolution, it is hardly compatible with the claimed 0.30 (GeV/c)^^ 

Confirmation that the pj resolution is much worse than claimed is given in Refs. [0] 
and [0]. Therein, the RFC time-of- flight resolution of p ~ 200 MeV/c pions that is equiva- 
lent to the pt resolution in the TPC is quoted as 260 ps. As succinctly proven in Refs. flT^ 
and r lTTH . a time-of-flight resolution of 260 ps of pions with pj = 200 MeV/c is equivalent 
to a resolution Apj/pj of 46%, which is worse by a stunning factor of 4.6 than the claimed 
resolution-^. 



''This result is obtained when taking literally two more claims by HARP: a beam-particle timing resolu- 
tion of 70 ps and an RPC timing resolution of 141 ps; however, it is more likely that the overall discrepancy 
of 4.6 stems from all three sources and not only from the bad pj resolution. 



Figure |I] also proves that HARP's pj resolution is much worse than claimed. The 
depth of the dip at q/pj = reflects directly the pj resolution, and HARP's dip is consid- 
erably more shallow than ours. 

The difference between HARP's and our q/pj spectra is consistent with a HARP bias 
of A(^/pt) ~ +0.3 (GcY/c)-\ and a HARP resolution of A(^/pt) ~ 0.55 (GeY/cyK 

The discrepancy between the q/pT spectra means that cross-sections are different by 
factors of up to two. 

The authors claim that results from the second concept of correcting dynamic track 
distortions and using the data from the full spill, is in 'excellent agreement' [Hj] with results 
from the first concept of not correcting for dynamic track distortions and using the first 
30% of the spill only. 

We agree that there is no difference in the results from these two concepts. Both are 
affected by a comparable pi bias and a comparably bad pj resolution. That the biases in 
HARP's two analysis concepts happen to have the same size and sign, is accidental. 

3. HARP'S '500 ps effect' 

The authors reported in Ref . [0] a 500 ps advance of the RPC timing signal of protons with 
respect to the one of pions. They confirmed their discovery in three subsequent publica- 
tions [H]-[0], and most recently in Ref. [0]. In the latter paper, the authors acknowledge 
that '...it has been pointed out that a similar behaviour can be obtained when a systematic 
shift in the measurement of momentum is present' but conclude that 'Momentum measure- 
ment biases in the TPC, if any, have been eliminated as possible cause of the effect.' 

In stark contrast, our group's interpretation of the authors' result is that their pi scale 
is systematically biased by A(1/pt) ~ 0.3 (GeV/c)~^ which leads to the prediction of a 
longer time of flight for non-relativistic protons (whereas the time of flight of relativistic 
pions is unchanged). In turn, if the proton momentum is considered correct, the RPC 
timing of protons would appear to be advanced. 

The relevant experimental variable is the proton time of flight as measured by the 
RPCs minus the time of flight calculated from the proton momentum. 

Figure shows HARP's respective data, taken from their most recent papers [Hj] (17 
Sep 2007) and [@] (24 Sep 2007), data which are based on their pi measurement in the 
TPC and hence affected by a bias in the TPC pi scale^. Also shown are data from the 
calculated momentum of recoil protons in elastic proton-proton scattering, published by 
HARP in Ref. [0], data that are not affected by a bias in the px measurement in the TPC. 

All three data sets should show the same time advance but disagree seriously with 
each other. This hardly supports the notion of a novel detector physics effect. 

Figure ^ shows the comparison of HARP and HARP-CDP data on the timing dif- 
ference of recoil protons from elastic proton-proton scattering. There is good agreement 



^All data shown in this Section refer to the RPC padring 3, i.e., to tracks with polar angles ^ 55-80°. 
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Figure 2. Time advance of protons (HARP data): time of flight measured by the RPCs minus the 
time of flight calculated from the momentum measured in the TPC ('Inelastic') and calculated from 
the kinematics of proton-proton elastic scattering ('Elastic'), respectively. 
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between the data which confirms that both HARP and HARP-CDP correctly calibrated 
the RPCs with relativistic pions. The data from elastic proton-proton scattering are con- 
sistent with the theoretically expected time advance (for the calculation of the theoretically 
expected time advance, we refer to our pertinent discussion in Ref. [USD)- 

Figure shows the comparison of HARP and HARP-CDP data for the case that the 
Pj reconstruction in the TPC is used to determine the time of flight of the recoil proton. 
While the HARP-CDP data confirm the results from proton-proton elastic scattering, the 
HARP data are inconsistent with these results. 

Figure ^ shows that HARP's time advance of protons (black points; data from Ref. [0]) 
is satisfactorily explained by a simulation of the time advance that results from a bias 
A(l/;?T)~0.30(GeV/c)-i. 

There is no need and no room for a novel detector physics effect. 



4. harp's 'physics benchmark' 

The authors make extensive use of elastic scattering of 3 and 5 GeV/c protons and pions 
on protons at rest to support the claim that their pj scale is correct within 3.5%. In the 
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Figure 3. Time advance of protons (HARP data and HARP-CDP data): time of flight measured 
by the RPCs minus the time of flight calculated from the kinematics of proton-proton elastic scat- 
tering. 



following we show that their arguments are not conclusive. 



4.1 Fits of recoil protons with and without beam point 

In stark contrast with our claim of a positive bias in q/pi in fits with the beam point, 
and a negative bias in fits without the beam point, the authors write 'The ratio of the 
unconstrained and constrained fits was checked to be unity with a high precision ' and show 
figure 4 in Ref . OH] in support of this claim. For its importance, this figure is reproduced in 
the left panel of our figure §. 

One would expect to see a Gaussian distribution in the authors' variable (pi — p2)/ p2 
{p\ is the momentum from a fit without the beam point, and p2 the momentum from a fit 
with the beam point). Since the claimed resolution with the beam point included is 0.30, 
and without the beam point about 0.60, the Gaussian should have a c ~ 0.50. Their plot 
shows something very different, though: a narrow spike centred at zero, on top of a broad 
distribution. The authors interpret this as evidence that the two fits give the same result. 

The spike at zero is an artefact which stems from the assignment of a wrong error 
in the r-0 position of clusters: the authors multiply the r-(^ error of each TPC cluster 
with cos 2^ (a conceptual mistake of their algorithm as discussed in Ref. OH) and hence 
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Figure 4. Time advance of protons (HARP data and HARP-CDP data): time of flight measured 
by the RPCs minus the time of flight calculated from the momentum measured in the TPC. 



produce nearly infinite weights of clusters close to the ^ angles 45°, 135°, 225° and 315°. 
In comparison with these wrong large weights, the weight of the beam point becomes 
negligible, which explains that the fits of tracks close to the singular ^ angles yield the 
same pj with and without the beam point. 

The expected Gaussian distribution with o of about 0.50 is indeed visible in their plot: 
it is the broad distribution below the artifical spike. This is evident from the right panel 
in figure § which shows a simulation how the Gaussian becomes deformed by the cos 2^ 
term. 

We conclude that the authors did not prove that the fits with and without beam point 
give the same result. Rather, they proved that their track fit is seriously compromised. 

4.2 Missing mass from elastic scattering 

The authors write 'A fit to the distribution [of missing mass squared] provides M^ = 
0.8809 ±0.0025 (GeV/c^)^ in agreement with the PDG value of 0.88035 (GeV/c^j^ ... 
a momentum scale bias of 15% would produce a displacement of about 0.085 (GeV/c^)^ 
on M^. As a result, we can conclude that the momentum scale bias (if any) is significantly 
less than 15%.' 

For its importance, their supporting figure 2 in Ref. OH] is reproduced in our figure 0. 
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Figure 5. HARP's time advance of protons (black points; data from Ref. [0]) compared with a 
simulation of the time advance that will result from a bias A{l/pj) ~ 0.30 (GeV/c)^^ 



The authors state that the fit of the recoil protons included the beam point. But they 
do not give important information: which fraction of the spill was used^, and they do not 
state how the significant energy loss of protons in materials before the TPC volume was 
handled^. 

Since the beam point was used, the bias in l/pj will be positive. For the typical pj of 
the recoil proton of 0.45 GeV/c, we estimate from the strength of the dynamic distortions 
in the respective data taking a bias A{l/pj) ~ +0.20 or, equivalently, Apj/pj ~ —10%. 
The difference to -i-15% in figure \J\ is important since the missing mass squared is not 
Gaussian-distributed. 

Figure ^ shows simulations of the missing mass squared in the elastic scattering of 
3 GeV/c protons on protons at rest. 

The left panel shows the difference, for a proton recoil angle of 69°, between a dis- 
tribution with a resolution of l/pj of 0.55 and no bias, and a distribution with the same 
resolution and a bias of -1-0.20. The missing mass squared distribution is less sensitive to a 
Pt bias than purported by the authors. 



^We assume that the first 100 events of the spill were used. 

^We assume that the proton energy loss was corrected as a function of the proton momentum measured 
in the TPC. 
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Figure 6. Left: HARP's comparison {pi — p2)/p2 of the fit witiiout beam point (pi) and witli the 
beam point (p2), for data and Monte Carlo; this figure is a copy from figure 4 in Ref. []II]; right: 
simulation of the expected Gaussian distribution of {pi — p2) /p2 (crosses) and of its deformation 
(shaded histogram) by HARP's cos 20 factor applied to the position error of TPC clusters. 
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Figure 7. HARP's missing mass squared in the elastic scattering of 3 GeV/c protons on protons at 
rest; this figure is a copy of figure 2 in Ref. OH]. 



10 



The right panel shows for a resolution of l/px of 0.55, and a bias of +0.20, the dif- 
ferences between the proton recoil angles of 65°, 69° and 73°, where the contributions 
from the three angles are weighted with their cross- sections. The sum of the three contri- 
bution may look 'Gaussian' but the central value of this 'Gaussian' cannot be taken as the 
physical missing mass squared. 

The rather erratic nature of results from this analysis is corroborated by the fit results 
of the missing-mass-squared distribution published by the authors in figure 15 in Ref. [0] 
and reported in Ref. [EOl . The result is 15.6a away from the PDG value. 

We conclude that the authors did not prove that their pj from fits with the beam point 
included is unbiased, certainly not with the precision claimed by them. Rather, they proved 
that their analysis of missing-mass-squared distributions is too simplistic. 
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Figure 8. Simulation of the missing mass squared in the elastic scattering of 3 GeV/c protons on 
protons at rest. Left: Simulation for a recoil proton angle of 69° with a resolution of l/pj of 0.55 
and no bias (open circles), with a resolution of 0.55 and a bias of +0.20 (black circles). Right: 
Simulation with a resolution of l/pj of 0.55 and a bias of +0.20 for proton recoil angle of 65° 
(open circles), 69° (full circles) and 73° (open squares). 



For comparison, we show in figure ^ our own results for the missing mass squared 
in the elastic scattering of 3 GeV/c protons on protons at rest, and compare them with a 
GEANT simulation. We show the data for two bins in the proton recoil angle, with a view 
to highlighting the differences both in shape and in rate. 

4.3 pt scale from elastic scattering 

From the comparison of the momentum of recoil protons from the scattering of 3 and 
5 GeV/c protons and pions on protons at rest as measured in the TPC, and as predicted 
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Figure 9. HARP-CDP data on, and GEANT simulation of, the missing mass squared in the elastic 
scattering of 3 GeV/c protons on protons at rest; data are shown as shaded histograms, the GEANT 
simulation (elastic scattering events only) as crosses; left: proton recoil angle between 71° and 72°; 
right: proton recoil angle between 65° and 66°. 



from the measurement of the scattering angle of the forward-going beam particle in the 
forward spectrometer, the authors conclude that '... a 10% bias [of the momentum scale] 
is excluded at 18 o level (statistics only)...' 

In this comparison, a fit without the beam point was used. This is important: (i) the pi 
resolution will be about twice worse than in fits with the beam point; and (ii) the expected 
bias from dynamic distortions will have different magnitude and opposite sign compared 
to the bias from fits with the beam point. 

Since all data published by HARP are based on fits with the beam point, evidence on 
a bias from dynamic distortions from fits without beam point is irrelevant; furthermore, 
conclusions from the dynamic distortions in one data set cannot be applied to another data 
set. 

We conclude that the authors have not proven that the pi scale of fits with the beam 
point is unbiased, and we could stop our argumentation here. 

Nevertheless, we follow the argumentation of the authors a bit further. 

We note that the authors chose to use only the first 50 events in the spill which reduces 
the expected bias from dynamic distortions by a factor of about two compared to the use 
of the first 100 events in the spill. 

We note that for reasons of acceptance, the use of the scattering angle of the forward- 
going beam particle restricts the recoil protons to the two horizontal sectors 2 and 5 of the 
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TPC. These are the two sectors which our group decided not to use for data analysis, for 
the much stronger electronics cross-talk and the many more bad electronics channels in 
comparison with the four other TPC sectors, and for the absence of cross-calibration of 
performance with cosmic-muon tracks. 

Still, one is puzzled why HARP find good agreement between the measured and the 
predicted momentum of the recoil proton. 

We know from our own analysis of the same data that they are affected by fairly strong 
dynamic distortions, albeit smaller in amplitude than the +8.9 GeV/c 5% Aabs data shown 
in Section ^ and with a steeper radial decrease of the Ar+ ion cloud in the TPC. We have 
shown in Ref. fETD that at the start of the spill, the so-called 'margaritka' effect is dominant 
with a sign that is opposite to the sign of the so-called 'stalactite' effect that becomes by far 
dominant later in the spill. Near the start of the spill, there is a partial cancellation between 
the two effects (the cancellation is not complete since the radial distributions of these track 
distortions are different). It is this accidental cancellation that has been exploited by HARP 
to claim that their analysis is not affected by a bias in the pj scale. 

We show in figure [T^ with the shaded histogram the absence of any momentum bias, 
and the momentum resolution, obtained by our group in the elastic scattering of 3 GeV/c 
pions and protons on protons at rest. Our resolution, from fits with the beam point in- 
cluded, is o{1/pt) ~ 0.20 (GeV/c)^^ well consistent with what is expected from our TPC 
calibration work fETH . It is unclear why the authors avoid proving their claim of a resolu- 
tion of o{1/pt ~ 0.30 (GeV/c)^^ by showing their analogous distribution. Rather, they 
argue their case with the much worse resolution from fits without the beam point (although 
the authors' missing-mass analysis is based on fits with the beam point). For comparison, 
their data (copied from the middle panel of figure 6 in Ref. QH]), are shown as open his- 
togram in figure [T^. Superimposed on their data is a Gaussian fit with a = 0.33. With 
an approximate pf = 0.45 GeV/c the authors' resolution is a(l/pT) = 0.73 (GeV/c)^\ 
worse than the 0.60 (GeV/c)^' expected for fits without beam points. This is consistent 
with the evidence shown in Section ^ that their resolution o{l/pj) is much worse than 
0.30(GeV/c)-i. 

5. Concluding commentary 

We presented evidence of serious defects in the large-angle data analysis of the HARP 
Collaboration: (i) the pj scale is systematically biased by A{l/pj) ~ 0.3 (GeV/c)^^; (ii) 
the pt resolution is by a factor of two worse than claimed; and (iii) the discovery of the 
'500 ps effect' in the HARP multi-gap RPCs is false. 

In defiance of explicit and repeated criticism of their work at various levels, including 
published 'Comments' fE3-fE311. HARP keep insisting on the validity of their work |3, Si- 

Yet HARP have been unable to disprove any of the critical arguments against their 
results. Their arguments in their defence confirm, rather than disprove, our claims of 
serious defects in their large- angle data analysis. 
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Figure 10. Resolutions 5(1//7t)/(1//'t) from HARP-CDP (shaded histogram) and from the 
HARP Collaboration (open histogram). 



In this unusual and regrettable situation, we warn the community that cross-sections 
that are based on the TPC and RPC calibrations reported by HARP, are wrong by factors 
of up to two. 
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